Challenges in Estimating the Effectiveness of COVID-19 Vaccination Using Observational Data.

The COVID-19 vaccines were developed and rigorously evaluated in randomized trials during 2020. However, important questions, such as the magnitude and duration of protection, their effectiveness against new virus variants, and the effectiveness of booster vaccination, could not be answered by randomized trials and have therefore been addressed in observational studies. Analyses of observational data can be biased because of confounding and because of inadequate design that does not consider the evolution of the pandemic over time and the rapid uptake of vaccination. Emulating a hypothetical "target trial" using observational data assembled during vaccine rollouts can help manage such potential sources of bias. This article describes 2 approaches to target trial emulation. In the sequential approach, on each day, eligible persons who have not yet been vaccinated are matched to a vaccinated person. The single-trial approach sets a single baseline at the start of the rollout and considers vaccination as a time-varying variable. The nature of the confounding depends on the analysis strategy: Estimating "per-protocol" effects (accounting for vaccination of initially unvaccinated persons after baseline) may require adjustment for both baseline and "time-varying" confounders. These issues are illustrated by using observational data from 2 780 931 persons in the United Kingdom aged 70 years or older to estimate the effect of a first dose of a COVID-19 vaccine. Addressing the issues discussed in this article should help authors of observational studies provide robust evidence to guide clinical and policy decisions.

Comparative effectiveness of two- and three-dose COVID-19 vaccination schedules involving AZD1222 and BNT162b2 in people with kidney disease: a linked OpenSAFELY and UK Renal Registry cohort study.

Background: Kidney disease is a key risk factor for COVID-19-related mortality and suboptimal vaccine response. Optimising vaccination strategies is essential to reduce the disease burden in this vulnerable population. We therefore compared the effectiveness of two- and three-dose schedules involving AZD1222 (AZ; ChAdOx1-S) and BNT162b2 (BNT) among people with kidney disease in England. Methods: With the approval of NHS England, we performed a retrospective cohort study among people with moderate-to-severe kidney disease. Using linked primary care and UK Renal Registry records in the OpenSAFELY-TPP platform, we identified adults with stage 3-5 chronic kidney disease, dialysis recipients, and kidney transplant recipients. We used Cox proportional hazards models to compare COVID-19-related outcomes and non-COVID-19 death after two-dose (AZ-AZ vs BNT-BNT) and three-dose (AZ-AZ-BNT vs BNT-BNT-BNT) schedules. Findings: After two doses, incidence during the Delta wave was higher in AZ-AZ (n = 257,580) than BNT-BNT recipients (n = 169,205; adjusted hazard ratios [95% CIs] 1.43 [1.37-1.50], 1.59 [1.43-1.77], 1.44 [1.12-1.85], and 1.09 [1.02-1.17] for SARS-CoV-2 infection, COVID-19-related hospitalisation, COVID-19-related death, and non-COVID-19 death, respectively). Findings were consistent across disease subgroups, including dialysis and transplant recipients. After three doses, there was little evidence of differences between AZ-AZ-BNT (n = 220,330) and BNT-BNT-BNT recipients (n = 157,065) for any outcome during a period of Omicron dominance. Interpretation: Among individuals with moderate-to-severe kidney disease, two doses of BNT conferred stronger protection than AZ against SARS-CoV-2 infection and severe disease. A subsequent BNT dose levelled the playing field, emphasising the value of heterologous RNA doses in vulnerable populations. Funding: National Core Studies, Wellcome Trust, MRC, and Health Data Research UK.

Comparative effectiveness of BNT162b2 versus mRNA-1273 covid-19 vaccine boosting in England: matched cohort study in OpenSAFELY-TPP.

OBJECTIVE: To compare the effectiveness of the BNT162b2 mRNA (Pfizer-BioNTech) and mRNA-1273 (Moderna) covid-19 vaccines during the booster programme in England. DESIGN: Matched cohort study, emulating a comparative effectiveness trial. SETTING: Linked primary care, hospital, and covid-19 surveillance records available within the OpenSAFELY-TPP research platform, covering a period when the SARS-CoV-2 delta and omicron variants were dominant. PARTICIPANTS: 3 237 918 adults who received a booster dose of either vaccine between 29 October 2021 and 25 February 2022 as part of the national booster programme in England and who received a primary course of BNT162b2 or ChAdOx1. INTERVENTION: Vaccination with either BNT162b2 or mRNA-1273 as a booster vaccine dose. MAIN OUTCOME MEASURES: Recorded SARS-CoV-2 positive test, covid-19 related hospital admission, covid-19 related death, and non-covid-19 related death at 20 weeks after receipt of the booster dose. RESULTS: 1 618 959 people were matched in each vaccine group, contributing a total 64 546 391 person weeks of follow-up. The 20 week risks per 1000 for a positive SARS-CoV-2 test were 164.2 (95% confidence interval 163.3 to 165.1) for BNT162b2 and 159.9 (159.0 to 160.8) for mRNA-1273; the hazard ratio comparing mRNA-1273 with BNT162b2 was 0.95 (95% confidence interval 0.95 to 0.96). The 20 week risks per 1000 for hospital admission with covid-19 were 0.75 (0.71 to 0.79) for BNT162b2 and 0.65 (0.61 to 0.69) for mRNA-1273; the hazard ratio was 0.89 (0.82 to 0.95). Covid-19 related deaths were rare: the 20 week risks per 1000 were 0.028 (0.021 to 0.037) for BNT162b2 and 0.024 (0.018 to 0.033) for mRNA-1273; hazard ratio 0.83 (0.58 to 1.19). Comparative effectiveness was generally similar within subgroups defined by the primary course vaccine brand, age, previous SARS-CoV-2 infection, and clinical vulnerability. Relative benefit was similar when vaccines were compared separately in the delta and omicron variant eras. CONCLUSIONS: This matched observational study of adults estimated a modest benefit of booster vaccination with mRNA-1273 compared with BNT162b2 in preventing positive SARS-CoV-2 tests and hospital admission with covid-19 20 weeks after vaccination, during a period of delta followed by omicron variant dominance.

Waning effectiveness of BNT162b2 and ChAdOx1 covid-19 vaccines over six months since second dose: OpenSAFELY cohort study using linked electronic health records.

OBJECTIVE: To estimate waning of covid-19 vaccine effectiveness over six months after second dose. DESIGN: Cohort study, approved by NHS England. SETTING: Linked primary care, hospital, and covid-19 records within the OpenSAFELY-TPP database. PARTICIPANTS: Adults without previous SARS-CoV-2 infection were eligible, excluding care home residents and healthcare professionals. EXPOSURES: People who had received two doses of BNT162b2 or ChAdOx1 (administered during the national vaccine rollout) were compared with unvaccinated people during six consecutive comparison periods, each of four weeks. MAIN OUTCOME MEASURES: Adjusted hazard ratios for covid-19 related hospital admission, covid-19 related death, positive SARS-CoV-2 test, and non-covid-19 related death comparing vaccinated with unvaccinated people. Waning vaccine effectiveness was quantified as ratios of adjusted hazard ratios per four week period, separately for subgroups aged ≥65 years, 18-64 years and clinically vulnerable, 40-64 years, and 18-39 years. RESULTS: 1 951 866 and 3 219 349 eligible adults received two doses of BNT162b2 and ChAdOx1, respectively, and 2 422 980 remained unvaccinated. Waning of vaccine effectiveness was estimated to be similar across outcomes and vaccine brands. In the ≥65 years subgroup, ratios of adjusted hazard ratios for covid-19 related hospital admission, covid-19 related death, and positive SARS-CoV-2 test ranged from 1.19 (95% confidence interval 1.14 to 1.24)to 1.34 (1.09 to 1.64) per four weeks. Despite waning vaccine effectiveness, rates of covid-19 related hospital admission and death were substantially lower among vaccinated than unvaccinated adults up to 26 weeks after the second dose, with estimated vaccine effectiveness ≥80% for BNT162b2, and ≥75% for ChAdOx1. By weeks 23-26, rates of positive SARS-CoV-2 test in vaccinated people were similar to or higher than in unvaccinated people (adjusted hazard ratios up to 1.72 (1.11 to 2.68) for BNT162b2 and 1.86 (1.79 to 1.93) for ChAdOx1). CONCLUSIONS: The rate at which estimated vaccine effectiveness waned was consistent for covid-19 related hospital admission, covid-19 related death, and positive SARS-CoV-2 test and was similar across subgroups defined by age and clinical vulnerability. If sustained to outcomes of infection with the omicron variant and to booster vaccination, these findings will facilitate scheduling of booster vaccination.

Comparative effectiveness of ChAdOx1 versus BNT162b2 covid-19 vaccines in health and social care workers in England: cohort study using OpenSAFELY.

OBJECTIVE: To compare the effectiveness of the BNT162b2 mRNA (Pfizer-BioNTech) and the ChAdOx1 (Oxford-AstraZeneca) covid-19 vaccines against infection and covid-19 disease in health and social care workers. DESIGN: Cohort study, emulating a comparative effectiveness trial, on behalf of NHS England. SETTING: Linked primary care, hospital, and covid-19 surveillance records available within the OpenSAFELY-TPP research platform, covering a period when the SARS-CoV-2 Alpha variant was dominant. PARTICIPANTS: 317 341 health and social care workers vaccinated between 4 January and 28 February 2021, registered with a general practice using the TPP SystmOne clinical information system in England, and not clinically extremely vulnerable. INTERVENTIONS: Vaccination with either BNT162b2 or ChAdOx1 administered as part of the national covid-19 vaccine roll-out. MAIN OUTCOME MEASURES: Recorded SARS-CoV-2 positive test, or covid-19 related attendance at an accident and emergency (A&E) department or hospital admission occurring within 20 weeks of receipt of the first vaccine dose. RESULTS: Over the duration of 118 771 person-years of follow-up there were 6962 positive SARS-CoV-2 tests, 282 covid-19 related A&E attendances, and 166 covid-19 related hospital admissions. The cumulative incidence of each outcome was similar for both vaccines during the first 20 weeks after vaccination. The cumulative incidence of recorded SARS-CoV-2 infection 20 weeks after first-dose vaccination with BNT162b2 was 21.7 per 1000 people (95% confidence interval 20.9 to 22.4) and with ChAdOx1 was 23.7 (21.8 to 25.6), representing a difference of 2.04 per 1000 people (0.04 to 4.04). The difference in the cumulative incidence per 1000 people of covid-19 related A&E attendance at 20 weeks was 0.06 per 1000 people (95% CI -0.31 to 0.43). For covid-19 related hospital admission, this difference was 0.11 per 1000 people (-0.22 to 0.44). CONCLUSIONS: In this cohort of healthcare workers where we would not anticipate vaccine type to be related to health status, we found no substantial differences in the incidence of SARS-CoV-2 infection or covid-19 disease up to 20 weeks after vaccination. Incidence dropped sharply at 3-4 weeks after vaccination, and there were few covid-19 related hospital attendance and admission events after this period. This is in line with expected onset of vaccine induced immunity and suggests strong protection against Alpha variant covid-19 disease for both vaccines in this relatively young and healthy population of healthcare workers.